CLAIMS 

We claim: 

1 A m ethod of restructuring a program comprising h asir hlnfrk s fnr-exgjfiHtirnrtSy~a processor 

liaving a memory hierarchy comprising a plurality of levels, said method comprising the steps 

a) ^constructing a Program Execution Graph (PEG) from control flow and 
frequency information from a profile of the program, the PEG comprising a weighted 
undirected graph comprising nodes representing the basic blocks and edges representing 
transfer of control betweenfcairs of the basic blocks, each of the nodes having a weight equal 
to the size of the basic block represented by the node, each of the edges having a weight 
equal to a frequency of transition between a pair of basic blocks represented by a pair of nodes 
connected by the edge; \^ 

b) partitioning the nodes of the PEG into clusters such that a sum of weights of 
the edges whose endpoints are in different clusters is minimized, and such that for any cluster, 
a sum of weights of the nodes in the cluster is no greater than an upper bound; and 

c) restructuring the basic blocks into contiguous codVcorresponding tothe 
clusters. \ 
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1 \^ The method of claim 1 further comprising the steps of: 

2 ^\ d) constructing a next PEG from the clusters of the partitioned PEG such that a 

3 node in trie-next PEG corresponds to a cluster in the partitioned PEG, and such that there is 

4 an edge betweerrtwo nodes in the next PEG if there is an edge between components of the 

5 clusters represented by thXtwo nodes; and 

e a e) assigning a weight to N each node of the next PEG; and 

7 W f) assigning a weight to an edge Between a pair of nodes of the next PEG 

8 5 representing a pair of clusters of the partitioned PES^the edge weight being a summation of 

9 il weights of edges in the partitioned PEG having endpoints^in the pair of clusters in the 
10 :. partitioned PEG. 

1 E?3. The method of claim 2 further comprising the step of: 

2 1 f) repeating steps b throuphf ^_ \ 



1 4. - The method of claim 1 wherein the upper bound is a multiple of a size of a level of the 

2 memory hierarchy. 



Tfi "I Sp^Ehe-mejhod -of cl aim 3 whei ein the uppc4 ^bound4era^eveH?fthe memory hierarchy, other 
J (J^ than a firstleveUsTsize-«f-l^^ level divided by an upper bound used to 

3 partition a next lower level of the memorymeTafChyr- — - — 
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1 7. Nv An article of manufacture for use in a computer system for restructuring a program 

2 comprising basic blocks for execution by a processor having a memory hierarchy comprising a 

\ 

3 plurality of levels, said article of manufacture comprising a computer-readable storage medium 

\ 

4 having a computer program embodied in said medium which may cause the computer system 

5 to: \. 

6 a) construct a Program Execution Graph (PEG) from control flow and frequency 

7 information from a profile of the program, the PEG comprising a weighted undirected graph 

8 ? = comprising nodes representing the basVblocks and edges representing transfer of control 

9 between pairs of the basic blocks, each ofthenodes having a weight equal to the size of the 

1 0 CO basic block represented by the node, each of theNedges having a weight equal to a frequency 

1 1 1= of transition between a pair of basic blocks representfedby a pair of nodes connected by the 

12 g edge; 

1 3 b) partition the nodes of the PEG into clusters such thaba sum of weights of the 

14 edges whose endpoints are in different clusters is minimized, and such tnat for any cluster, a 

15 P sum of weights of the nodes in the cluster is no greater than an upper boundNand 

16 c) restructure the basic blocks into contiguous code corresponding to the clusters. 
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1 The article of manufacture of claim 7 wherein the computer program may further cause the 

2 \computer system to: 

3 dK construct a next PEG from the clusters of the partitioned PEG such that a node 

4 in the next PEG-corresponds to a cluster in the partitioned PEG, and such that there is an 

5 edge between two ncides in the next PEG if there is an edge between components of the 

6 clusters represented by thetwo nodes; and 

7 m e) assign a weight to eabhnode of the next PEG; and 

g =p f) assign a weight to an edge between a pair of nodes of the next PEG 

9 II representing a pair of clusters of the partitioned PEG^the edge weight being a summation of 

1 0 I\ weights of edges in the partitioned PEG having endpointsin the pair of clusters in the 

1 1 P partitioned PEG. 

1 9. The article of manufacture of claim 8 wherein the computer program may farther cause the 

2 computer system to: 

3 c f ) - — repeat-steps b th rough f. 



1 10. The article of manufacture of claim 7 wherein the upper bound is a multiple of a size of a level 

2 of the memory hierarchy. 

j H . Th e a rt icleuof manufacture of claim i fl j»hp i min thw w pper-hound lot a level ol tne memory 
"2 hierju-chyTolheTthar^^ memory hierarchy level divided by an upper 

3 bound used to partition a next lower level of thelnemoTyinefawdiy^^^ 
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1 \3. A computer system for restructuring a program comprising basic blocks for execution by a 

2 \ processor having a memory hierarchy comprising a plurality of levels, said computer system 

3 comprising: 

4 a) ^sa Program Execution Graph (PEG) constructed from control flow and 

5 frequency informafron from a profile of the program, the PEG comprising a weighted 

6 undirected graph comprising nodeS|representing the basic blocks and edges representing 

7 transfer of control between pairs of the basic blocks, each of the nodes having a weight equal 

8 f 3 to the size of the basic block represented by the node, each of the edges having a weight 

9 !S; equal to a frequency of transition between a pair of basic blocks represented by a pair of nodes 

10 CO connected by the edge; \. 

1 1 j= IJ b) a partition of the nodes of the PEG imctclusters such that a sum of weights of 

12 = the edges whose endpoints are in different clusters is minimized, and such that for any cluster, 

13 q a sum of weights of the nodes in the cluster is no greater tharran upper bound; and 

14 O c) a restructuring of the basic blocks into contiguous cooe corresponding to the 

15 clusters. \ 
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1 ^^Nv The computer system of claim 1 3 further comprising: 

\ 

2 ^Xd) a next PEG constructed from the clusters of the partitioned PEG such that a 

3 node in theNiext PEG corresponds to a cluster in the partitioned PEG, and such that there is 

4 an edge betweeiHwo nodes in the next PEG if there is an edge between components of the 

5 clusters represented by^the two nodes; and 

6 a e) a weight assigned to'each node of the next PEG; and 

7 CO f) a weight assigned to an edge between a pair of nodes of the next PEG 

8 =C representing a pair of clusters of the partitioned PEG^theedge weight being a summation of 

9 fl weights of edges in the partitioned PEG having endpoints irhhe pair of clusters in the 
10 partitioned PEG. 

1 -15. The computer system of claim 14 further comprising: \^ 

2 ______ _ f ) a repetit ion of elements b through f. 



1 16.. The. computer system of claim 1 3 wherein the upper bound is a multiple of a size of a_level of 

2 the memory hierarchy. 



17^^ie_gmputer-system^f^a^ the i ippeHrouna tor a level ot the memory 

2 gj^i hierarchy, otherlhalTalfrsHe*^^ hierarchy level divided by an upper 

3 bound used to partition a next lower level of the memoT3rTtte4^a_iy^^ 
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